Motor Variability in Complex Gesture Learning: Effects of Movement Sonification and Musical Background

With the increasing interest in movement sonification and expressive gesture-based interaction, it is important to understand which factors contribute learning how. We explore effects of users’ musical background on motor variability complex gesture learning. an empirical study musicians non-musicians learn two sequences over three days, with without sonification. Results show interlaced interaction these how they unfold three-day process. For 1, fast dynamic a direct “action-sound” sonification, induces higher for both day 1. While reduce this similar level as no auditory feedback condition 2 3, remain have significantly variability. Across also lower than non-musicians. 2, slow smooth “action-music” metaphor, there are virtually effects. Based findings, we recommend future studies take into account participants’ background, consider longitudinal examine gestures, use awareness when interpreting results given specific design sound.